Network algorithmics and the emergence of synchronization in cortical models 
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When brain signals are recorded in an electroencephalogram or some similar large-scale record of 
brain activity, oscillatory patterns are typically observed that are thought to reflect the aggregate 
electrical activity of the underlying neuronal ensemble. Although it now seems that such patterns 
participate in feedback loops both temporally with the neurons' spikes and spatially with other brain 
regions, the mechanisms that might explain the existence of such loops have remained essentially 
unknown. Here we present a theoretical study of these issues on a cortical model we introduced 
earlier [A. Nathan and V. C. Barbosa, Phys. Rev. E 81, 021916 (2010)]. We start with the deflnition 
of two synchronization measures that aim to capture the synchronization possibilities offered by the 
model regarding both the accumulation of potential at the neurons' membranes and the spiking 
activity of the neurons. We present computational results on our cortical model, on a model that 
is random in the Erdos-Renyi sense, and on a structurally deterministic model. We have found 
that the algorithmic component underlying our cortical model ultimately provides, through the two 
synchronization measures, a strong quantitative basis for the emergence of both types of synchro- 
nization in all cases. This, in turn, may explain the rise both of temporal feedback loops in the 
neurons' combined electrical activity and of spatial feedback loops as brain regions that are spatially 
separated engage in rhythmic behavior. 

PACS numbers: 87.18.Sn, 87.19.lj, 89.75.Fb 



I. INTRODUCTION 

Current technology allows the recording of electromag- 
netic brain activity at several different scales, ranging 
from invasive recordings that capture the signals from 
neuronal ensembles comprising thousands to millions of 
cells to those that are noninvasive (like the electroen- 
cephalogram) and capture the signals from large-scale 
cortical areas [l[. Invariably the recorded signals appear 
as oscillatory patterns which, depending on the scale at 
which the recording is performed, occur in different fre- 
quency ranges and provide distinct interpretive possibili- 
ties. At the smallest scales, for example, the recorded sig- 
nals occur in the range of a few kilohertz and are thought 
to reflect the combined spiking (or firing) activity of the 
group of neurons in question. The signals recorded at the 
largest scales, on the other hand, occur in the range of a 
few to 100 hertz and are thought to reflect the so-called 
local field potentials (LFPs) that are purported to reflect 
the aggregate effects of all the electrical activity taking 
place in the corresponding area [2|- 

LFPs have acquired great prominence recently, ow- 
ing mainly to the fact that LFPs related to different 
brain areas appear to combine with one another in such 
ways as to correlate significantly with the brain's sensory- 
motor mechanisms and other, higher-level functions as 
well (such as memory, attention, and others; cf. Refs. 
[3-Q and references therein). The ways in which LFPs 
combine seem to involve forms of cross-frequency cou- 
pling that cover wide temporal and spatial ranges and 
ultimately promote the integration of activities with dif- 
ferent temporal and spatial characteristics [5|. Decoding 
the various forms of LFP coupling may one day hold the 



key to understanding how computation and communica- 
tion take place in the brain. 

As it happens, though, many aspects of the nature of 
LFPs have remained elusive. In particular, their precise 
origin and relation to the underlying firing activity of 
the neurons seem to depend crucially on the brain re- 
gion being considered. However, notwithstanding this 
indefiniteness that still surrounds the specifics of LFP 
emergence and interaction with other LFPs, some of the 
crucial points are beginning to be clarified [2, [g|- One 
of them is the relation with the combined firing activ- 
ity of groups of neurons. Although LFPs seem to derive 
largely from the accumulation of potential at the neu- 
rons' membranes that eventually leads to neuronal firing, 
it appears that the firing patterns themselves have a role 
to play as well. As a consequence, a picture that seems 
to be emerging is that of a feedback loop in which the 
larger-scale LFPs both influence and get influenced by 
the smaller-scale firing patterns. Another point is more 
related to the spatial characteristics of how LFPs interact 
with one another: It now seems clear that feedback loops 
also occur involving the LFPs of distinct brain areas. 

While a complete resolution of these issues will cer- 
tainly require considerable further research, it seems clear 
that a detailed understanding will benefit from a clear 
picture of firing synchronization at the neuronal level. 
By synchronization we mean both the convergence of 
multiple action potentials onto a single cell within a rela- 
tively narrow temporal window, and also the firing due to 
such potentials by different cells within a similar window. 
As we mentioned above, both phenomena are closely re- 
lated to the rise of LFPs, and consequently the rise of the 
higher-level functions that LFPs are thought to support. 



In our view, accounting for the possibilities the brain af- 
fords for the appearance of such synchronized behavior 
depends both on the anatomical properties of how neu- 
rons interconnect and on the individual firing behavior of 
each neuron. Our aim in this paper is the study of these 
types of synchronism on a graph-theoretic model of the 
cortex. 

Our study is preceded by a few others [7H9| , all of which 
have modeled neuronal behavior as a continuous-time 
process in which the relevant signals obey certain differ- 
ential equations and feed some measure of synchronous 
activity. Invariably these models have targeted the syn- 
chronization of membrane potentials, and have for this 
reason stayed apart from most of the relevant details 
that characterize neuronal firings, like the so-called lo- 
cal histories of each neuron [l^]- Our approach is to 
take a different course and focus on the extent to which 
certain events at the various neurons can be said to be 
synchronized. These events are, in essence, the arrival 
of action potentials from other neurons and the eventual 
creation of new action potentials. These, of course, are 
precisely the events that make up membrane potentials, 
but we have found in previous studies of related prob- 
lems that the additional level of detail pays off by provid- 
ing unprecedented insight. Examples here are the emer- 
gence of the synaptic- weight distribution, in which case 
we demonstrated that experimentally observed distribu- 
tions Inl c an be reproduced [iJI, and a more tractable 



version [135 of the integrated-information theory for the 
emergence of consciousness 14] . 

Our model is based on what is generally called net- 
work algorithmics. In our case this refers to the combina- 
tion of a structural component to represent the anatom- 
ical properties of the cortex at the neuronal level, and a 
distributed-algorithmic component to represent the traf- 
fic of action potentials among the neurons as they fire. 
The distributed algorithm in question is inherently asyn- 
chronous [15], and as such never makes any reference to a 
global-time entity. As a result, every property emerging 
from neuronal interactions is, according to this model, 
the result of strictly local elements. The presence of such 
strong asynchronism may seem contradictory with the 
search for signs of synchronism. However, we have found 
that observing the system from the outside can reveal 
surprising synchronization possibilities that could never 
be known within the scope of individual neurons, pro- 
vided we uncover the causal relationship that binds those 
local elements on a global scale. 

Although our model is substantially more detailed than 
those that target membrane potentials as the basic ana- 
lytical units, clearly there would be room for considerably 
more detail, even down to the molecular level. Our ap- 
proach, therefore, resides in the middle ground between 
two extremes and as such is related to what has become 
known as the artificial-life approach [1^, [131 > whose "life 
as it could be" metaphor is close in spirit to our own view. 
Our approach is also part of a growing collection of efforts 
that attempt to tackle eminent problems of neuroscience 



from the perspective of g raph-based and other interdis- 
ciplinary methods [l8l - l28t . As an enterprise that eventu- 
ally seeks to be able to handle realistically large problem 
instances from a graph-theoretic perspective, the present 
study is moreover in line with the many others that in 
the last decade have addressed the so-called complex net- 
works [imi. 

We proceed in the following manner. First we briefly 
review our cortical model in Sec. |lTl We then introduce 
our measures of synchronization in Sec. Illll and continue 
on to methods and results, given in Sees. IIVI and |Vl re- 
spectively. We discuss our results in Scc. lVII and conclude 
in Sec. EI] 



II. CORTICAL MODEL 

Our model is defined on a strongly connected directed 
graph S, i.e., a directed graph in which it is possible 
to reach every node from every other node through di- 
rected paths only. We assume that S has TV nodes, each 
representing a neuron, so each one can be either exci- 
tatory or inhibitory in the proportion of 4 to 1, respec- 
tively [33 - l34| . In 5, an edge exists directed from node 
i to node j to indicate a synapse from i's axon to one 
of j's dendrites, but no edge can connect two inhibitory 
nodes |32j. The results we describe in the remainder of 
the paper for our cortical model are predicated upon S 
being drawn from the following random-graph model on 
n > N nodes in such a way that S is the giant strongly 
connected component, GSCC [3a|, of the directed graph 
D that is actually drawn. In D a randomly chosen node, 
say j, has out-degree k > with probability proportional 
to fc"^-^13 Following Refs. [43,|43], each of these k nodes 
is precisely another randomly chosen node, say j, with 
probability proportional to e~'^^^ , where dij is the Eu- 
clidean distance between nodes i and j when all n nodes 
are placed uniformly at random on a radius- 1 sphere. We 
have observed this policy for edge placement to lead to 
N « 0.9n on average (i.e., we expect the GSCC of D, 
and hence S, to comprise roughly 90% of the n nodes) 

All nodes in S share the same rest and threshold po- 
tentials, denoted by v'^ and w*, respectively, such that 



< V . We use Vj to represent the potential of node 



^ Originally the choice of this scale-free distribution |36| was in- 
spired by related work that observed such a power law at a higher 
level of detail in the cortical architecture |37l.l38||. but recent mea- 
surements regarding the distribution of neuronal (undirected) de- 
grees [39| seem to support the choice we made \13 ■ We note that 
the adoption of this power law to describe the distribution of out- 
degrees represents a significant departure from earlier modeling 
attem pts [33 . |40|| , which used randomness in the Erdos-Renyi 
sense |4ll directly. We note, moreover, that cortices do exhibit 
many other scale- free properties l27l . |42| . l43l ] , including some that 
evince their small- world nature [4411 . the existence of hubs (nodes 
with very large out-degrees) , and others |45l . [46| . 



j and Wij to represent the synaptic weight of the edge 
directed from i to j. At all times, these are constrained 
in such a way that Vj e [u°,u*] and Wij £ [0,1]. An 
asynchronous distributed algorithm, henceforth referred 
to as A, underlies the node-potential and synaptic-weight 
dynamics of our cortical model. At node j, algorithm A 
is built around the "firing" operation which consists of 
sending a message to each out-neighbor of j in 5* and 
setting Vj to the rest potential w" . Algorithm A is purely 
reactive, that is, it only acts at any node when the node 
receives a message. Evidently there must be exceptions 
to this purely reactive character, since at least one node 
must send messages out spontaneously to start the algo- 
rithm. We call such nodes initiators and let to < A^ be 
the number of initiators in a given run of algorithm A. 
When node j acts as an initiator (this happens at most 
once in a run for that node), it simply fires with prob- 
ability 1. When it reacts to the reception of a message, 
say from node i, node j performs the following steps: 

1. If i is excitatory, then set Vj to min{u*,Wj -I- Wij}. 
If it is inhibitory, then set Vj to maxlw", Vj — Wij}. 

2. Fire with probability {vj — u°)/(w* — w"). 

3. If firing did occur during step 2, then set Wij to 
Tiim{l,Wij + S}. If it did not occur but the pre- 
vious message received by node j from any of its 
in-neighbors did cause firing to occur, then set Wij 



to (1 



Utj. 



The parameters S and a appearing in step 3 are con- 
strained hy 6 < a [12i ). They are meant to reproduce, 
although to a limited extent, the spike-timing-dependent 
plasticity principles [43, [5^ , which roughly dictate that 
Wij is to increase if firing occurs and decrease otherwise, 
always taking into account how close in time the relevant 
firings by nodes i and j are. Moreover, increases in Wij 
are to occur by a fixed amount, decreases by proportion 
[5ll453l | . Every run of algorithm A is guaranteed to even- 
tually reach a point at which no more message traffic 
exists. It is then said to have terminated. 



III. MEASURING SYNCHRONIZATION 

The problem of handling synchronization during a run 
of an asynchronous distributed algorithm such as algo- 
rithm A is akin to that of handling simultaneity in spe- 
cial relativity. A convenient framework within which to 
tackle it is then the event-based formalism originally laid 
down in Ref. [54]. Informally, an event in the present 
context is said to have occurred whenever it is possible 
for a node to fire. As we explained in Sec. [ill this can oc- 
cur independently of any message reception by the node 
(in the single occasion, if any, in which the node oper- 
ates as an initiator) or as a response to the arrival of a 
message. Moreover, if firing does occur during the event 
then messages are sent out by the node. 



In a more formal description, we regard the run in 
question as a set R of events. An event r € Ris described 
by the 4-tuple r — {i,ti,mi, Mi), where i identifies the 
node of S at which event r occurs, ti > 1 indicates that r 
is the tith event to occur at node i since the run began, 
rrii is the message (if any) that triggered the occurrence 
of the event, and Mi is the set of messages sent by node 
i if it fires during the event. Many of the events in R 
are implicitly related to one another. We make such a 
relation explicit by defining the binary relation B C R'^. 
Given events r as above and r' — {j,tj,mj,Mj), we say 
that the ordered pair {r,r') G i? if and only if either (a) 
i and j are the same node and ti < tj with no interven- 
ing event between r and r' or (b) j is an out-neighbor of 
i and rrij G Mi (i.e., the message that triggered r' was 
sent in connection with the occurrence of r) . We inter- 
pret {r,r') G B as meaning that r happened at node i 
immediately before r' . If (a) is the case, then this use of 
"before" seems natural because both ti and tj are relative 
to the same (local) time basis. Extending this interpre- 
tation to case (b), though apparently less natural, is still 
consistent because there is no reference in this case to 
either ti or tj. Closing B under transitivity yields an- 
other binary relation on R, here denoted by B"*", such 
that B C B+ C R'^. This relation can be interpreted in 
such a way that (r, r') G _B+ means that r happened be- 
fore r' regardless of how close the specific nodes at which 
they occurred are to each other. Through i?+, therefore, 
relation B is the core of a characterization of how the 
events of run R relate to one another causallyo 

Relation B is also instrumental in our characterization 
of synchronization in run R. The first step is to recog- 
nize that it naturally gives rise to a directed graph whose 
node set is R (the set of events) and whose edge set is 
B. This graph is necessarily acyclic (no directed cycles 
are formed) and allows the definition of event r's depth, 
denoted by depth{r), as follows. Given a directed path 
in the graph between two events, let the path's length 
be defined as the number of edges on the path that cor- 
respond to messages. That is, the edges contributing to 
the path's length are those that fall under case (b) above 
in the definition of relation B. We define depth{r) as the 
length of the lengthiest path leading to r. Intuitively, 
depth{r) is the size of the greatest causal chain of mes- 
sages leading up to event r during run R. 

We use two measures of synchronization. They are 
both based on the premise that, if the sequence of events 
at two neurons (nodes of S) can be aligned with each 
other so that sufficiently many event pairs of the same 
depth become matched in the alignment, then there is 
more synchronism between the two sequences than there 
would be with fewer event pairs aligned. We do this se- 
quence alignment as described next. Let i and j be the 



^ In particular, if r and r' are such that neither (r, r') G B~^ nor 
(r' , r) G B~^ , then the situation is analogous to the space-like 
separation of events in special relativity. 



two neurons in question and let their event sequences 
during run R be e^ , e^, . . . , ef ' and ej , e|, . . . , e ■ ^ , re- 
spectively, where L^ and Lj are the sequences' sizes. 

Let fiij = ma,x{ depth {e j^ '), depth {cj')}, i.e., fiij is the 
depth of the last event of the two sequences that is deep- 
est. We do the alignment of the two sequences by cre- 
ating two new size-fXij sequences, viz. ti,t2, . . . ,t^.- and 
ui,U2, ■ . • , Ufj_.^ for the first measure, and xi,X2, ■ ■ ■ , a;^.^ 
and yi,y2i ■ ■ ■ ,yfj.ij for the second measure, each with 
defining characteristics that depend on the particular 
measure of synchronization under consideration. 

The first measure aims to capture the synchroniza- 
tion that may exist in the overall fiow of messages and, 
through it, in the accumulation of potential at the neu- 
rons' membranes. As such, it is based on positioning, 
relative to the t sequence, those of the Li events of neu- 
ron i that promoted the accumulation of potential, and 
likewise the Lj events of neuron j relative to the u se- 
quence. For k — 1,2,. .. ,ij,ij, the t sequence is such that 
tk ^ k ii k = depth{ef) for some i G {1,2, ... ,Li}; if 
not, then tk — depth{e^~^) (unless £ = 1, in which case 
tk ~ 0). The u sequence is defined entirely analogously 
for neuron j. 

If, for example, the events in the two original se- 
quences have depths 2,3,3,7,8,9,11 and 1,3,4,5,5,9 
for i and j, respectively, then the t sequence 
is 0,2,3,3,3,3,7,8,9,9,11 and the u sequence is 
1,1,3,4,5,5,5,5,9,9,9. Thus, the fcth position of se- 
quence t or u equals k' such that < A;' < fc if and 
only if the corresponding neuron received at least one 
message of depth k' during the run and, for k' < k, never 
since did the neuron receive a message whose depth is in 
the interval [k' + l,k]. It equals otherwise. The first 
measure of synchronization is denoted by p^, for neurons 
i and j. It is given by 



Pii = — 



1 ^ min{ifc,Mfe} 



Mu ^ max{ifc,Ufc} 



(1) 



(assuming 0/0 = 1). Clearly, p~- G [0, 1] and grows with 
the similarity of sequences t and u. For identical se- 
quences we get p~j — 1. The example above yields 
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7 + 8 + 9 + 9+TT 



0.69. 



(2) 



The second measure addresses the synchronization 
possibilities that may exist as the neurons fire. In this 
case only those of the Li events of neuron i that entailed 
firing are positioned relative to the x sequence, and like- 
wise the Lj events of neuron j with respect to the y 
sequence. For k = 1,2, ... ,pij, the x sequence is such 
that Xk = k \i k = depthief) for some £ G {1,2,..., Li] 
such that neuron i fired at the occurrence of ef; if not. 



then Xk = 0. The y sequence is defined analogously for 
neuron j. 

Following up on the examples given above, and assum- 
ing that neuron i fired at one of its depth-3 events and 
neuron j fired at all its events except those of depth 5, 
the X sequence is 0,0,3,0,0,0,0,0,0,0,0 and the y se- 
quence is 1, 0, 3, 4, 0, 0, 0, 0, 9, 0, 0. Thus, the fcth position 
of sequence x or y equals A; > if and only if the corre- 
sponding neuron fired upon receiving a depth- fc message. 
It equals otherwise. For neurons i and j, the second 
measure of synchronization is denoted by p^ and given 
by 



n+ — 






min{xk, yk} 
Pi] ^ max{xfc,yfe} 



(3) 



(assuming 0/0 = 1). As in the previous case, p^- G [0, 1] 
and grows with the similarity of sequences x and y. Iden- 
tical sequences yield p^ = 1. For the example above we 
get 
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0.73. 
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For a fixed pair i,j of neurons, both p~- and pf- seek 
to characterize the possibility of synchronized behavior 
during run R. They do this by quantifying the extent 
to which the events occurring at the two neurons could 
be said to happen synchronously if a time basis existed 
common to neurons i and j and time according to this 
basis elapsed along increasing event depth. Of course, 
our cortical model per se has no need for such a time 
basis and is algorithmically correct regardless of any tim- 
ing assumptions one may make regarding the delay for 
action-potential propagation down the axons. However, 
the kind of synchronized behavior we are investigating 
occurs at a variety of temporal and spatial scales, there- 
fore some time-related assumption is inevitable if we are 
to extract any meaning out of the multitude of neuronal 
events. Our choice seems reasonable because, concep- 
tually, it contrasts with the algorithm's inherent asyn- 
chronism only minimally: Every single pair of neurons 
is given its own time basis for the computation of p~ 
and pj, and this is reflected on the notationally explicit 
dependency of pij on the i,j pair. Furthermore, view- 
ing increasing event depth as time may even have some 
biological plausibility to it. In fact, it appears that the 
delay for an action potential to reach the various synapses 
connecting out of the same axon is independent of how 
much of the axon actually has to be traversed [5^ [56| . In 
these terms, what our assumption does is to generalize 
this independence for a group of axons. 

Notwithstanding this common underlying feature of 
the two synchronization measures, they are also markedly 



different in how they use event depth to assess the sim- 
ilarity of two event sequences. In the case of p^, this 
is done rather stringently, since only same-depth firing 
events and the 0/0 ratios contribute to it. In the case of 
p~ , these continue to be some of the strongest contribu- 
tors, but now they are joined by any pair of same-depth 
events (not necessarily firing ones). Moreover, now an 
event's depth lingers until a greater-depth event occurs 
and in the meantime continues to influence p^-. 



IV. METHODS 

Our computational results, to be given in Sec. |Vl are 
based on the same methodology we followed in Ref. [13] , 
of which we now provide a brief review for the reader's 
benefit. We use w° = -15, w* = 0, 5 = 0.0002, and 
a = 0.04 in all runs of algorithm A on S. Each run 
starts at TO = 50 initiators chosen uniformly at random 
and progresses until termination. 

The directed graph S can be of one of types (i)-(iii), 
as explained next. In order to keep the computational 
effort reasonably bounded with current technology, the 
directed graph D of which S is the GSCC has n = 100 
nodes. 

(i) In this case D is sampled from the cortical model 
described in Sec. |lTl As explained in that section, 
the corresponding S is expected to have iV w 90 
nodes. The expected in- or out-degree in D is 3.7. 

(ii) In this case D is sampled from the generalized 
Erdos-Renyi model of directed graphs [571] • Given 
the expected in- or out-degree z, an edge is placed 
from each node i to each node j ^ i with prob- 
ability z/{n — 1). For consistency with type-(i) 
graphs we use z — 3.7, in which case S is such 
that N K, 100 with high probability. 

(iii) In this case D has a deterministic structure and is 
by construction strongly connected. So S = D and 
N = 100. The structure of D is that of the directed 
circulant graph (5^ with in- or out-degree equal to 
[3.7] = 4. If we number the n nodes 0, 1, . . . , n — 1, 
then in D every node i has nodes i -f 1, i + 2, i + 3, 
and i + 4 (modulo n) as out-neighbors. 

For each fixed S, 0.2N nodes are chosen uniformly at ran- 
dom to be inhibitory, so long as no two of these nodes are 
connected by an edge [note that, if S is of type (iii), then 
all 20 inhibitory nodes are in fact placed deterministi- 
cally, since necessarily they are found at equal intervals as 
we traverse the nodes in the order 0, 1, . . . , n — 1]. More- 
over, for each S node potentials and synaptic weights are 
chosen uniformly at random from the intervals [w'',^*] 
and [0,1], respectively. For type-(iii) graphs this is the 
only source of nondeterminism. 

We use 50 S instances of each type. For each fixed S we 
use 50 000 run sequences of algorithm A, each sequence 
comprising 10 000 runs. The first run in a sequence starts 



from the node potentials and synaptic weights chosen for 
the graph. Each subsequent run in the sequence starts 
from the node potentials and synaptic weights at which 
the previous run ended. Along each sequence we observe 
the behavior of p~ and pfj for each pair i,j of distinct 
nodes at six checkpoints. The first of these occurs be- 
fore any run actually takes place. Each of the remaining 
five occurs after 2 000 additional runs have elapsed. The 
observation that takes place at a checkpoint is based on 
100 additional runs, called side runs, each starting at its 
own set of m randomly chosen initiators and from the 
node potentials and synaptic weights that are current at 
the checkpoint. At the end of the side runs, the main 
sequence of runs is resumed from these same node po- 
tentials and synaptic weights. 

The contribution of each side run concerning a fixed 
pair i,j of distinct nodes is to record the values of p~- 
and pfj at the end of the run, as well as tag them with 
the labels S^iin — minjjy , Jj^} and ^max — max{(5ij,(5ji}, 
where Sij and Sji are the directed distances between the 
two nodes in S (from i to j and from j to i, respectively). 
After all 2.5 x 10^ side runs for a graph type have been 
completed at a checkpoint, we calculate the average val- 
ues of p~j and plj over all node pairs having the same 
tags. These averages are henceforth denoted by p~ and 
p^, respectively. 



V. COMPUTATIONAL RESULTS 

Our results are presented in Figs. [T] and [21 for type-(i) 
graphs. Figs. [3] and |4] for type-(ii) graphs, and Figs. [5] 
and [B] for type-(iii) graphs. The former figure in each 
pair refers to /o~, the latter figure to p+. Each figure 
comprises six panels, each panel for each of the six ob- 
servational checkpoints. The (a) panels refer to the first 
checkpoints, the (b) panels to the second checkpoints, 
and so on. Each panel is organized as a two-dimensional 
array and gives the p~ or p+ averages as a function of 
the node pairs' S^i^ values (as abscissas) and Jmax val- 
ues (as ordinates). We display these averages by means 
of a color code that assigns different colors to different 
intervals inside [0, 1] suitably. The hues we use vary from 
a dark shade of red to a dark shade of green, indicating 
the lowest interval and the highest one, respectively. We 
note that, even though this choice of colors is practically 
the same through all the figures, they may correspond to 
different intervals in absolute terms. 

Each average displayed in these figures refers to di- 
rected cycles in the S graphs whose length is ^min + ^max 
for the particular S^in and (5max values in question. Be- 
cause of the strongly connected nature of S, every two 
nodes belong to at least one common directed cycle. By 
the definitions of Smin and ^max, each average plotted 
in the figures is therefore relative to all node pairs for 
which the shortest of these cycles has the same length. 
In particular, traversing any of the array diagonals for 
which 5min -l- ^max is a coustaut merely shifts the rela- 
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FIG. 1. (Color online) Average value of p- for type-(i) graphs as a function of Smin and 5max- Data are given for the first 
checkpoint (a) through the sixth (f). 



tive positions of the two nodes involved in each pair on 
the shortest directed cycle that they share. We hence- 
forth refer to the value of Smin + i^max for a certain 
node pair as the pairs' girthjj Moreover, we refer to 
the pair as being more or less balanced on the directed 
cycle of length Smin + <5max, depending respectively on 
whether Smax — <5min is close to or not (i.e., close to the 
^min = <5max diagonal of the array) . 

All panels in Figs. [1] through |6] display their data inside 
the upper triangular region relative to the 5min = ^max 



^ In a free extension, to a node pair, of the homonymous notion 
in graph theory that concerns the entire graph in the undirected 



diagonal of the array. All blank spots inside this re- 
gion refer to ^min, ^max pairs that never occurred in any 
of the S instances we used. This can be verified by 
resorting to Fig. [71 where the probability distributions 
for the occurrence of these pairs are shown for type-(i) 
and type-(ii) graphs [in panels (a) and (b), respectively, 
through the use of color codes similar to those of the 
previous figures]. As for type-(iii) graphs, it follows eas- 
ily from their definition that either (Jmin + Smux — N/A or 
(^min + iJmax = N/A+1, respectively 25 or 26 for iV = 100, 
so in this case these fixed girth values are the constraints 
determining the appearance of blank spots (that is, they 
appear when the constraints are violated). 

Figure [7] is also useful in helping elucidate which of 
the various possible girth values in type-(i) and type-(ii) 
graphs are the most common. Readily, girths of about 
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FIG. 2. (Color online) Average value of pf- for type-(i) graphs as a function of Smin and 5max- Data are given for the first 
checkpoint (a) through the sixth (f). 



18 or less are by far the most common in type-(i) graphs. 
This value becomes about 12 for type-(ii) graphs. In 
the forthcoming discussion, we use these rough delimiters 
to characterize what happens to most node pairs (i.e., 
those whose girth values are overwhelmingly the most 
common) . 



VI. DISCUSSION 

The results for p^ , given in Figs. [U [3l and [3 provide 
a clear picture of what is to be expected regarding the 
overall synchronization that may be present in the flow 
of messages as they get received at the neurons. In the 
case of type- (i) graphs (Fig.[T|), already at the first check- 
point most node pairs i,j have p~- values in the interval 



(0.7, 0.85]. Four thousand runs later (that is, at the third 
checkpoint) this holds for the interval (0.9,0.95]. At the 
sixth and last checkpoint, the interval is (0.9, 1]. A closely 
analogous conclusion holds in the case of type- (ii) graphs 
(Fig. [3]), now with the intervals (0.6,0.85] for the first 
checkpoint, (0.9, 0.95] for the third, and (0.9, 1] for the 
last one. As for type-(iii) graphs (Fig. [5]), their rigidly 
constrained girth values lead p~ to be concentrated inside 
the interval (0.7,0.75] at the first checkpoint for nearly 
all node pairs. Similarly, already at the third checkpoint 
the situation that we observe in the last checkpoint has 
been established and p~- is concentrated in the interval 
(0.9,0.95] for nearly all node pairs. 

It is curious to observe for type-(iii) graphs that, at all 
checkpoints, all node pairs of girth 26 for which Smin — 1 
have p~- values occupying intervals one or two notches 
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FIG. 3. (Color online) Average value of p^ 
checkpoint (a) through the sixth (f). 



for type-(ii) graphs as a function of Smin and (5max- Data are given for the first 



above the intervals we gave for nearly all pairs, that is, 
(0.8,0.85] for the first checkpoint and (0.95,1] for the 
third checkpoint and onwards. Revisiting Figs. [1] and |3l 
we see that a similar conclusion holds also for type-(i) 
and type-(ii) graphs: Node pairs for which (5,„in is near 
1 tend to have a slightly higher p~- value if their girth is 
sufficiently large. 

The results for p+, which relates to how much syn- 
chronization may be present as neurons fire, tell a story 
that differs from that of p~ in important ways. The first 
of these differences is clear from Figs. [21 HI and [6l For 
all graph types the range of occurring p~^ values is wider 
by roughly 50-100% than that of the p~ values. In fact, 
the p"*" values are now scattered inside the (0.4, 1] inter- 
val for all graph types at the earliest checkpoints and 
inside (0.5, 1] at the latest ones. Readily, then, accord- 



ing to our two measures of synchronization there appear 
to be substantially fewer synchronization possibilities in 
the firing of neurons than in the accumulation of poten- 
tial as refiected by the reception of messages. This can be 
quantified by examining the data more closely, as follows. 

For type-(i) graphs (Fig. [2]), at the first checkpoint 
most node pairs have plj values in the interval (0.4, 0.8]. 
At the last checkpoint, if we ignore all node pairs for 
which (5min — 1 for the time being then nearly all node 
pairs have p^ values in the interval (0.9, 1] [the single ex- 
ception is that of ^,nin = ^max = 2, for which the interval 
is (0.8,0.9]]. The case of type- (ii) graphs (Fig. g]), stiU 
disregarding all (5min = 1 entries, is closely analogous to 
that of type-(i) graphs, the differences being that now 
most node pairs span the larger interval (0.4, 1] already 
at the first checkpoint and that, without exception, at 
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FIG. 4. (Color online) Average value of p'l- 
checkpoint (a) through the sixth (f). 



for type-(ii) graphs as a function of Smin and (5max- Data are given for the first 



the last checkpoint all node pairs hit the interval (0.9, 1]. 
Finally, if we go on focusing on node pairs for which 
(^min > 1 exclusively, then for type-(iii) graphs (Fig. [6]) 
all node pairs have pf^ values in the interval (0.4, 0.5] at 
the first checkpoint. At the last checkpoint, on the other 
hand, this interval becomes (0.8,0.9] if (5min — 2, (0.9, 1] 

if (5min > 2. 

As Figs. [21 m and[6]denionstrate, the Smin — 1 case sets 
itself apart from the others for all graph types at nearly 
all checkpoints. For example, if we concentrate on the 
last checkpoint, at which we believe the model's dynam- 
ics to have already settled into some sort of stationary 
regime [l3|, then for both type-(i) and type-(ii) graphs it 
holds that pf, tends to increase from some value in the 
interval (0.4, 0.5] when the girth is 2 to some value in the 
interval (0.9, 1] when the girth is close to the rough up- 



per bound we set earlier for declaring most node pairs to 
have been counted [i.e., roughly 18 for type (i), roughly 
12 for type (ii)]. Naturally, increasing the girth while 
Smin is held fixed at 1 implies considering node pairs that 
are progressively more imbalanced, since ^max grows with 
the girth. The case of type-(iii) graphs is different in this 
respect, as for ^,„in = 1 all node pairs have pf, values in 
the interval (0.6, 0.7], regardless of which value of (Jmax is 
in question (either 24 or 25). These pairs, however, are 
of course highly imbalanced as well. 



VII. CONCLUDING REMARKS 

As we mentioned in Sec. HI a notion that is becoming 
increasingly central to the study of synchronization in 
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FIG. 5. (Color online) Average value of p. 
checkpoint (a) through the sixth (f). 



for type-(iii) graphs as a function of Jmin and Jmax- Data are given for the first 



the brain is that of feedback loops, both in a temporal 
sense (as LFPs and neuronal firing patterns exert influ- 
ence on one another) and in a spatial sense (as the LFPs 
of spatially separated areas affect one another). The re- 
sults we have obtained with our algorithmic model of a 
cortex lend support to this notion both in the temporal 
and in the spatial sense. 

In the temporal sense we have found ample evidence 
that our distributed algorithm A is capable of promoting 
abundant opportunities both for potential to be accu- 
mulated in a synchronized way as messages are received 
at the neurons and for neurons to fire in a synchronized 
manner. We have found that this holds across all three 
graph types, from the cortical model first introduced 
in Ref. [12], to an Erdos-Renyi directed graph, to the 
completely deterministic and tautly shaped structure of 



a directed circulant graph. In our view, this indepen- 
dence from the graph's structural characteristics points 
at an inherent ability of algorithm A at providing what 
seems to be the necessary foundations for brain synchro- 
nization. Notwithstanding this, our results do also shed 
some light on the role played by graph structure. As it 
happens, only type-(i) graphs provide the opportunity of 
long-distance (in the sense of graph distances) synchro- 
nization in the two senses we have studied. 

In the spatial sense there are two important issues to 
be highlighted. The first one is that, although by Fig. [7| 
node pairs having higher-than-18 girth are rare, they do 
occur and have yielded high p~ and p~^ values at all the 
observational checkpoints. The exact significance this 
may have in the case of real cortices is unknown, to the 
best of our knowledge, since spatial feedback loops are 
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FIG. 6. (Color online) Average value of pf, for type-(iii) graphs as a function of (Smin and Jmax- Data are given for the first 
checkpoint (a) through the sixth (f). 
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known only for very small graph distances 0, 3- ^o 
the fact that they may also occur at significantly larger 
graph distances remains a tantalizing possibility. The 
second important issue is the presence of such strong de- 
pendence of p+ on a node pair's girth when Smm = 1 as 
we observed. Our results indicate that in this case the 
synchronization of neuronal spikes is favored on feedback 
loops involving highly imbalanced pairs of neurons (i.e., 
node pairs for which Smax ^1)- As with the first issue, 
the significance this may have for real cortices is unknown 
and merits special attention as further data are obtained. 
All our results depend strongly on the measures of syn- 
chronization we gave in Eqs. ^ and ([3|). They also de- 
pend on the model summarized in Sec. [Ill but that is now 



backed up by interesting validating finds [12|, |l3| and has 
therefore proven its usefulness as an artificial-life abstrac- 
tion. It then seems that furthering our study of emerg- 
ing synchronization properties depends on validating our 
two measures in a way that ties our causality-based def- 
initions to real data as tightly as possible. We expect 
to be able to do this as further insight into real cortices 
becomes available. 
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